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USER SELECTABLE HARDWARE ZOOM IN A VIDEO DISPLAY SYSTEM 
FioiHnftha Invention 

The present invention relates to a method and associated apparatus for providing 
6 a user selectable hardware zoom in a video display system. 

Rark qround of *ha Invention 

Computers are important tools In today's society, and the computer display is an 
essential component of one's workspace. The importance of computer displays 

1 0 for the efficiency of work is demonstrated by the presence of larger displays and 
multiple displays when the display "real estate" becomes important to one's work. 
In some cases, larger displays allow for more "real estate" to be displayed. Dual 
displays are usually driven by independent display controllers, and the operating 
system (e.g. Windows 98™) is informed that the "desktop" or display surface is to 

15 be displayed on one side by one display controller and on the other side by the 
other display controller. This is typically done using two independent graphics 
subsystem accessing two separate and independent memory subsystems. Dual 
displays have an advantage over larger displays in many cases because with 
CRT monitors, the depth of the monitor is in proportion to the screen size, and 

20 large screens take up significant physical desktop surface area. It can sometimes 
be impossible to set up a 20" CRT monitor, while it is possible to set up two 15" 
monitors on the same desktop surface. The cost of two 15 inch monitors is also 
typically less than half that of one 20 inch monitor. 

25 While providing a greater physical surface area for the computer display output 
provides satisfactory results in many work environments, there is a need to have 
better display detail for work requiring attention to detail, such as graphics work, 
in which a zoom or scaling of the area to be worked on is essential. Conventional 
zoom is done by the application programs themselves, i.e. the user selects a 

30 zoom level for a display, and the application provides a magnified view of the 
object being worked on, such as a document, drawing or image; mostly, this 
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zoom covers or replaces the previous image on the display. Some application 
programs provide a smaller window with a representation of a whole page of a 
document or image, while the main viewing portion of the display provided the 
zoomed image. 

5 

Conventional zooming techniques operate to satisfaction when the applications 
provide them, however, the user often needs to command the application 
program to switch between zoom levels in order to edit a document correctly, 
since perspective is essential to proper editing. There is therefore a need to 
0 provide for a display-based zoom for providing a user with the ability to view an 
accurate zoom of a portion of a main display surface on one display, while being 
able to view the entire main display surface on the other in the case of multiple 
monitor configuration. 

5 It Is also known In the art to provide a single display controller hardware zoom in 
which the zoom operates to scale a fixed portion of a main surface memory, such 
as, for example, an area which is one quarter the size of the main surface 
memory, in which each pixel of the main surface memory is displayed as four 
pixels in the zoom display. The portion of the main surface memory can be 

>0 displaced or dragged using the mouse. The known hardware zoom does not 
provide for a user defined magnification ratio to be used, and is limited to a fixed 
or a set of pre-defined magnification ratios. 



Summaiv of the Inventioji 

It is an o^iebt^f the present invention to provide a method for implementing a 
hardware z^ornVwhlch a user specifies a point and a dimension of a window or 
frame associated withsme point within a main display, and the hardware zoom 
automatically s^les a mabqmum portion of the window selected to a full screen 
view. The full screen zoom m^e provided on a different display than the main 
30 display, with the niain display rem^g unchanged by the selection. This allows 
the user to simply define any area onltt« display using an input device with the 
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result ti^at th^V^(in(Jo^N automatically gets scaled full screen. This offers the 
flexibility \)f not limiti(^ the user to determine a scale factor, but to instead define 
the area ^at they areNnterested in working on and having it z<y3xt\&i full screed 
to the desired display ahd resolution. Once the frame has been defined, the 
frame can be^moved relati^to the movement of an input device if a panning 
feature is enabled 

It is also an object of the present invention to provide a method for Implementing 
a hardware zoom which allows for a non-integer fraction of a main display 
surface memory to be zoomed. By a non-integer fraction is meant a fraction 
which is not 1/n. where n is an integer, and thus a 1:n scaling is not possible. 
Such non-integer fractions, as user defined by selecting a zoom window using a 
GUI, provide a more user friendly operation. 

According\o\he invention, there is provided a method of providing a display 
surface zoo\n i\a display controller system having a main surface memory and 
at least one zoor^display device. The method comprises the steps of: 

receiving user input defining either a fixed position frame portion within the 
main surface memoW or a non-integer fraction of the main surface memory; 

determining aVresolution of the zoom display device and optionally 
adjusting the aspec^ rau^ of the portion defined by the user input to correspond to 
its resolution: 

scaling the us^r selected portion of the main surface memory; 
converting the ^aled\ortion of the main surface memory into a display 
signal; and 

signa\o the zoom display device. 



outputting the display^ 




^is^lay- 



Thrrrf' r^rf hv^ ^^^^'^ ^^y^ 0 ^ riftterminino thr rr n f i l ii t iri rM ;) f the - 
device and adjusting the aspect ratiooTttifi-portionrll^el^ is to determine 
the suitable asped-ratie-basea'orvtheresolution of the zoom display and to force 
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then to adiustJhe^frSfi^^ respect the aspect ratio based on the resolution 
- of it hergSom d i s play. 

According to aspects of this invention, one graphics controller with one or 
multiple Cathode Ray Tube Controllers (CRTC's) allows the user to select any 
rectangular area (zoom window) on one display and have it zoomed full screen 
on the second display (or on any other of a larger number of displays) In realtime. 

The- zuoiMui i IhH j,t^u>iiU3j c ^^ to ov oi d piKdirtW:)!! ul unn i l^ iud lu 

ay pixel viewing aj rijeditingi — . 

rie location of the selected zoom area once defined can be static In order to fix 
th\zoom window on one region of the display or locked to the movement of any 
.input through an Input device (keyboard, absolute or relative pointing 
device^e.g. mouse). 

With the present invention, the user can view both the entire application (or the 
desktop in general) on one screen and any area of this desktop zoomed to full 
20 screen on the second display. This can be extended to include multiple defined 
areas on multiple secondary displays and even multiple defined areas on one 
secondary display. For the latter, the user will need to toggle between the various 
zoom areas once they have been defined. 

25 The user may also reselect a different area or zoom window (any size) whenever 
desired. 

It is also possible to use a single display device, and to toggle between a display 
of the main surface memory and one of the user selected zoom windows on the 
30 same display. In the case of a multiple display desktop displaying the main 



jij 8:25FM SWABEY OGILVY MTL 514 288 8589 NO. 68?? F, 8/3 

1 Docket 10442-4US 



III 



surface memory, the invention may also allow the user to toggle between a zoom 
window and the main surface memory for one or all display devices. 

The invention may also provide for an automatic recognition of an application 
5 program being run on the user's computer and to store user defined zoom 
window parameters in association with a particular application program. In this 
way. user activation of the zoom function can cause the particular window or set 
of windows associated with the application program to be displayed on the zoom 
display. Thus switching between applications programs may automatically cause 
1 0 the zoom window to change accordingly. 

Brief Descri ption of thft Drawings 

The invention will be better understood by way of the following non-limiting 
detailed description of a number of prefenred embodiments with reference to the 
1 5 appended drawings, in which: 

Fig. 1 is a high level block diagram of the display controller system 
according to the first prefen-ed embodiment; 

Fig. 2 is a flow chart of the zoom control process according to the second 
preferred embodiment in which scaling is perfonned using a 3D drawing 
20 engine; 

Fig. 3 illustrates a screen image of a primary and secondary display 
according to the preferred embodiments; 

Fig. 4 is a high level block diagram illustrating the display controller system 
according to the second preferred embodiment in which the zoomed display 

25 toggles between two buffers and a zoomed hardware cursor is provided and 
the scaling is performed using a 3D drawing engine; 
Fig. 5 is a high level block diagram illustrating the display controller system 
according to the third preferred embodiment in which the zoomed display 
toggles between two buffers and the main hardware cursor is blit directly 

30 onto the zoom buffers; and 



5 



M 16. 2000 8:26PM SWABEY OGILVY MTL 514 288 8389 NO. 68?? P. 9/30 

^ ^^ocket 10442-4US 

Fig. 6 is a high level block diagram illustrating the display controller system 
according to the fourth preferred embodiment in which the zoomed display 
toggles between three buffers; 

Fig. 7 is a high level block diagram Illustrating the display controller system 
6 according to the fifth preferred embodiment in which the zoomed display 

CRTC reads the zoom area or portion of the main display surface and uses 

its backend scaler to produce the zoomed image; and 

Fig. 8 is a high level block diagram illustrating the display controller system 

according to the sixth preferred embodiment in which the zoom area or 
10 portion of the main display surface is blit or copied into a separate buffer 

from which the zoomed display CRTC reads the zoom area and uses its 

backend scaler to produce the zoomed image. 

no»ailfed Description of the Pr oferred embodiments 

15 In the first preferred embodiment, two independent display controllers (a primary 
display and a secondary display controller) are each able to generate a stream of 
pixel data and associated synchronization signals (syncs) from pixel data 
contained in a display memory (surfaces). The two display controllers can drive a 
variety of output ports including any combination of RGB D/A converters, video 

20 encoder, and TDMS Panel Link or LCD interface. This permits many display 
combinations such as but not limited to two RGB monitors, two TV monitors, two 
flat panel displays or any mix of them. 

Fi g u r r 1 -i hnw i ^'i^*^ '^■"^k diagram- of th o proforred emb o f 1 imRnlJ " w n 
25 CRTC's 1 1 and 12 are capable of fetching one or moredigplay^uffaces from a 
single frame buffer memory (50) whichcanJie-SG^ SDRAM, or any other 
type of Random Access Men^^^iH^:^^ CRTC may also contain one or 
more backend scalefTl^Mer to Figure 2) that allows the input surfaces to be 
re-scaled^;WfiilCwithin the context of the present invention, each controller 11 
30 2Ba:^-^iosS not need lu dcceAa moro than ono surfa c fl. g reat e r image 
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These surfaces can be in a variety of pixel formats including but not limited to 
RGB (8. 16. 24. 32) and YUV (4:2:0 . 4. 2, 2). The output of each CRTC can be 
displayed on a CRT monitor. TV or flat Panel displays via appropriate converters, 
encoders and transmitters. The multiplexers 33 and 34 allow routing of the output 
of each CRTC to either display. This allows either display to receive the output 
from either CRTC. 

The user zoom controller 16 in the preferred embodiments is provided by 
software at the level of at least the device driver and utilities which allow the user 
to select from a variety of options to use the zoom capabilities. These can include 
but are not limited to: 

Filtering: on or off; 

Panning or Mouse Following: on or off; and 

Destination resolution: Automatic or user defined (from any allowed 
resolution) 

Toggling between different zoomed surfaces and/or main display surface 
Enabling and disabling association with applications 

Enabling and disabling zoom is done via (but not limited to) pre assigned (or user 
defined) Hot-keys or other combinations of keys (or mouse buttons) or icon 
buttons etc. Furthermore each of the above options can be easily toggled on and 
off or they can be automatic and user defined using pre-assigned (or user 
defined) hot keys or the like. 



figure fh^'*^" - fl""" '^-hnrt foi -th fe - ei n buUi ni tj i il il l ustge d j n ri gsjLarid 5. Whon ■ 
the end user enables the zoonuising^aii^^ software allows the 

30 user to select^J^etangularw^ from the primary display. One example of 
S0^Ihe-- tU a L U >c uiicr ho lds down the mou o o Key at which p o int the ' 
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drags the mouse while holding down the key and stops>tbe-cofnei^^ 
opposite the first one to specify the rectan^ie^mTl^o of the key. At this point 
the coordinates of the corneMiiagtSH^ opposite the first one are determined 
and this informationJs<grW» to specify the size and location of the zoom 
window. OfjxttifsSjnere are many other ways to determine this rectangular area 
witbotrTdiparting from the spirit and scope of the invention. The coordinates of 
tow (iiiUu dt ng address m memQfy) am thus stu i tfJ. — ' 

10 The itfsululiu i i uf Uie OhisUiiciliun tan be c i ther automatica ll y ca l cul a t ed-otaigfic 
defined. When it is user defined, the software usesthisj:BS0h3tlorr In the 
preferred embodiment, it is automatic, it could^e-cftos^n a variety of ways 
ranging from (but not limited to) the^^loselfstandard resolution (to the resolution 
of the zoom window) tottjeHSifgest resolution possible etc. These resolutions 
determination optipnTc^Talso be specified by the user. Once the destination 
resolution^-ch^en, the scaling factor is determined. This determination of the 
scaflDaJaGtoHs-wim tn I I n:; gb i i tfid l knowKiUytf of those in skilled in th e art. > 

The resolution and thus the dimensions of the pixel array of the secondary zoom 
20 display device may be very different from the resolution and dimensions of the 
primary display device. For example, the secondary display could be a portrait 
display providing a zoom of a full page of text displayed within the main surface 
memory when a word processor application is mnning. This can allow a whole 
BVa" by 11" document page to be zoomed to full size and edited on the second 
25 display using a display as small as a 13" monitor, whereas a 20" monitor is 
required to view the same page when the monitor is operated in landscape 
mode. As mentioned above, there is a significant cost difference between a 13" 
and a 20" display, making the secondary 13" display operating in portrait mode 
an efficient use of display resources. The primary display can then be accessed 
30 for all toolbars and menus within the application, and the fixed portion of the main 
display containing the document page is displayed on the secondary display as a 
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full page. If the secondary portrait display is configured to operate in portrait 
mode, then the selected window is directly zoomed. Portrait monitors and some 
flat panel displays can operate in this manner. If the secondary display operates 
in landscape mode and is simply turned on its side, then the selected window in 
5 the main surface memory may be copied into a buffer in memory 50 in a way so 
as to rotate the surface 90 degrees. The rotated surface can then be displayed 
on the landscape monitor turned 90 degrees on its side to provide a portrait 
display of the selected window. 

10 With-kn owledytf of t he destination r e solution, a b uffe r of thi o jrocok 
reserved in memory for the zoomed area (zoombu^f)r.Af?^^ 
multiple buffers can be allocatedJf^lDuWroi^ buffering is desired and when 
multiple zoom windows^ar^^^. The secondary CRTC is then programmed 
to read fromJttriT^ buffer (or set of zoom buffers). If panning or (mouse 
1 5 follqy«n^y^re is enabled then the location of the zoom window is consistentty 
! higure 4.' 

The parameters associated with a zoom window or set of zoom windows or the 
selected portion or set or portions of the main surface memory to be displayed on 

20 the zoom display can be stored in association with a particular application 
program. This option may'be selected or deselected by the user. When zoom 
windows are associated with applications, the launch of an application or 
switching to an application may automatically select the zoom window or set of 
zoom windows for the application. In the case that a number of zoom windows 

25 can be defined for the same display, and the user is allowed to toggle through 
the zoom windows, the selection of an application can be used to switch to the 
zoom window associated with the application, and thereafter, the user can toggle 
through the other zoom windows if a different zoom window is desired. 

30 In this embodiment, the 3D drawing engine 60 of the graphics controller is used 
to scale the pixels from the main display buffer to the zoom buffer. While the 
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scaling capabilities of the 3D drawing engine are typically used for scaling 
textures for 3D objects, the capability can easily be leveraged to scale any type 
of surface with pixels by treating the surface as a texture. If filtering is enabled 
then the 3D engine scales with filtering enabled. The type of filtering can include 
5 but is not limited to bilinear filtering. 

Once the CRTC is programnr\ed to operate according to the invention, it 
constantly reads from the appropriate zoom buffer and outputs to the display, 
while the 3D Drawing engine 60 keeps refreshing the appropriate zoom buffer 
10 with the scaled pixels from within the zoom window (the window may or may not 
be moving depending on. the status of the panning feature). 

— " Figure 5 showk a representation of the hardware in an embodiment using 3D 

(drawing engine\) and two zoom buffers. The area selected in the nnain display 

15 buffer in memory SjO is scaled and written into the zoom buffer by the 3D drawing 
engine 60. Figure Si illustrates double buffering so two zoom buffers have been 
shown. In this caseVe drawing engine 60 alternates between the two buffers. 
Meanwhile CRTC2 lV reads from the buffer that the drawing engine 60 has 
finished writing and white the drawing engine 60 is updating the other buffer. This 

20 is done to prevent unn^ssary flickering that may occur with single buffering 
and to ensure thai the drawing engine has completely updated the zoom buffer 
from which the CRTC2 12 ikreading. 

It will be appreciated that the hardware cursor which is overlaid on top of the 
25 main display may also need to be scaled so that is can be seen on the secondary 
display. Alternatively, the hardware cursor can simply be BLIT (bit block 
transferred or copied) into the zoom buffer directly (see Figure 6). 

CRTC1 11 reads the full image for the primary display from the primary display 
30 buffer (with the hardware cursor overiay) and CRTC2 12 reads the zoomed 
image from the zoom buffer and displays it on the secondary display (with the 
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overiaid zoomed hardware cursor). It will be appreciated that the second display 
will always be a realtime zoomed version of the primary display. The user could 
chose to do all editing by looking at either display and it will get instantly updated 
on both displays. 

5 

Figure 7 shows the same implementation with triple buffering. Three buffers are 
allocated in memory, and the 3D drawing engine 60 and CRTC2 12 cycle 
through these buffers. Triple buffering is useful for minimizing any dependencies 
that may be imposed by the refresh rate limitations of the particular display being 
10 used. 

Alternative!?^ using the 3D drawing engine 60, the backend scaler 14 of CRTC2 
12 can also be\sed to scale the zoomed window (see Figure 8). The CRTC2 12 
is set to read frAthe location where the zoom window is located and the scaler 
is programmed to sc^ using the determined scale factor. The zoom window can 
be fetched directly froha the main display buffer or the zoom window can be 
copied (blit) into another\aion in memory and the CRTC2 (12) can read from 
there (see Figure 9^ In thi^^se the control of filtering and non-filtering, will 
depend on the filterina capabilitiW of the specific scaling unit used. 

S 20 

1^ While the description of the invention uses two controllers as the preferred 

embodiment, it can easily be extended or scaled to additional controllers. 
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It will be appreciated that the zoom control can accept user input for adjusting a 
25 non-integer scale value to be increased and to be decreased by very small steps 
by redefining a new zoom window whose length or width or both can be selected 
to the nearest pixel on the main display. This allows for the input to cause a 
sliding zoom magnification in either the upwards and downwards direction, i.e. 
either to increase the zoom magnification to a maximum value or to decrease the 
30 zoom magnification down to a minimum value, which may be actual size. 
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